Papers with task accuracies
Do LLM hallucination detectors suffer from low-resource effect? (2026.eacl-long)
Copied to clipboard
| Challenge: | a long line of work suggests that LLMs face issues along both dimensions . |
| Approach: | They investigate hallucination detectors' failure modes and their effects on the task accuracy of four LLMs and three halluciner detectors. |
| Outcome: | The models show impressive performance in high-resource languages like English but the performance degrades significantly in low-resourced languages like Bengali. |
On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers (2021.findings-acl)
Copied to clipboard
Tianchu Ji, Shraddhan Jain, Michael Ferdman, Peter Milder, H. Andrew Schwartz, Niranjan Balasubramanian
| Challenge: | Recent work shows that attention can be pruned to zeros with minimal loss in accuracy. |
| Approach: | They propose a pruning technique which quantizes attention to a 3-bit format without retraining . they find that 80% of attention values can be pruned to zeros with minimal loss in accuracy . |
| Outcome: | The proposed approach produces only a few unique attention values with minimal loss in accuracy. |